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ABSTRACT: The paper presents a model of university teaching where students 
are involved in concrete activities and collaborate while developing key compe- 
tences for the academic and working future. 52 students of the Degree Course in 
Psychology at the Sapienza University of Rome participated to the activity. The 
method of data collection and analysis combines qualitative and quantitative ap- 
proach. Results show a general perception of skills enhancement and a good ap- 
preciation of the course, especially in comparison with traditional learning modes. 
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1. Theoretical introduction 


One of the main goals of secondary and higher education is to en- 
sure that students acquire useful skills to achieve success not only in their 
studies, but also in their future career and in daily life. A comprehensive 
list of 21* century skills has been provided by Binkley et al. (2012) who 
identified ten skills grouped into four clusters: ways of thinking (e.g., 
creativity and innovation, critical thinking, problem-solving, decision- 
making, learning to learn, and metacognition); ways of working (e.g., 
communication and collaboration — teamwork); tools for working (e.g., 
information literacy, ICT literacy), and living in the world (e.g., citizen- 
ship; life and career; personal & social responsibility). By mastering such 
skills, tomorrow’s citizens should be able to solve complex problems, in- 
novate work knowledge practices, create and support professional net- 
works, and cope with multiculturality and continuous change. 

To enhance meaningful and long-lasting learning that can promote 
knowledge acquisition as well as crucial skills development, more recent 
literature (Pozzi et al. 2012; Schellens et al. 2006) asks for educational ap- 
proaches in which to: fruitfully integrate individual and group activities, 
structure and guide focused learning discussions, think about specific tasks 
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around concrete activities, and finally, provide theoretically-based techno- 
logical mediation. 

Based on these concepts, the authors are presenting their proposal on 
how to innovate higher education accordingly, by designing a type of 
course in which students are involved in concrete activities, and collabo- 
rate to create knowledge and build significant artefacts while developing 
key competences for their academic and working lives. 

The course is based on the Trialogical Approach to Learning (TLA, 
Paavola, Engeström, Hakkarainen 2010), so-called because it integrates 
‘monological’ and ‘dialogical’ approaches to learning with a third element: 
intentional processes involved in the collaborative creation of knowledge 
artefacts shared by and useful for the community. The acquisition and 
participation metaphors of learning (Sfard 1998) are, in this approach, em- 
bedded in the knowledge creation metaphor, which, by going beyond the 
many traditional dichotomies (Paavola, Lipponen, Hakkarainen 2004), 
focuses on the individual and social processes, conceptual knowledge and 
social practices needed to foster collaborative creativity (Fig. 1). The trial- 
ogical approach demonstrates its strong links with the Cultural Historical 
Activity Theory (CHAT) (Engeström 1987). Starting from Vygotskij’s 
thinking (1981), according to which our experience of the world is al- 
ways mediated by a tool, whether tangible or intangible, CHAT perceives 
knowledge as a collaborative construction mediated by cultural and social 
artefacts, and grounded in practical activities (Cole 1996). 


Figure 1 —The trialogical learning approach. [Sansone, Cesareni, Ligorio 2016] 
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A trialogical approach is applied through six principles, the so-called 
‘design principles (Tab. 1: Hakkarainen, Paavola 2009; Paavola, Hak- 
karainen 2014), which guide the planning of technology-based teaching 
and learning activities to facilitate shared efforts of working with knowl- 
edge artefacts (Paavola, Lakkala, Muukkonen, Kosonen, Karlgren 2011). 
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Table 1 — The six design principles. 
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Design Principle 


Definition 


DP1 Organizing activities around 
shared ‘objects’ 


Formative action must converge on the realization 
of shared objects recognized as important and in- 
tended for actual use, beyond individual and social 
dimensions of learning. Shared objects are also rep- 
resented by shared practices and processes. 


DP2 Supporting interaction between 
personal and social levels 


It is necessary to combine individual work with 
that in a team, considering the diverse needs and 
“exploiting” inclinations and interests. 


DP3 Fostering long-term processes 
of knowledge advancement 


This principle emphasizes the importance of pro- 
viding enough time for iterative inquiry cycles and 
of supporting environments to let long-term pro- 
cesses take effect, including the creative re-use of 
previous practice and knowledge artefacts. 


DP4 Emphasizing development 
through transformation and reflec- 
tion between various forms of knowl- 
edge and practices 


Innovative ideas and practices can emerge more 
easily when learning involves various forms of 
knowledge and practices: declarative, procedural 
as well as tacit. 


DP5 Cross-fertilization of various 
knowledge practices across commu- 
nities and institutions 


Creating connections within other contexts inten- 
tionally promotes the acquisition of modes of in- 
teraction, ways of thinking and languages typical 
of contexts other than those of training. 


DP6 Providing flexible tool 
mediation 


In line with 21* century society, the last principle 
affirms the importance of providing adequate and 
diversified technologies, selecting those most suit- 
ed to mediate collaborative activities and enhance 
aspects highlighted in the other design principles. 


The six principles synthesize the main pillars of the TLA: designing 


object-based learning activities in which both individual and collabora- 
tive work strategies are mobilized, creative processes are triggered, and 
educational technologies support each stage of the process. In particular, 
trialogical activities are favoured by the use of environments and tools 
that allow participants to create and share, elaborate and transform, or- 
ganize different artefacts, making the related knowledge practices vis- 
ible, reflecting on them and evolving them. 


2. Methodology 
2.1 Aims 
The study presented here aimed to observe students’ acquisition of 


knowledge and skills, and to gather useful information for improving 
learning design. Specifically, our research questions were: 
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1) Do students perceive an evolution in the level of skills they mastered 
at the beginning and at the end of the course? 
2) How do students evaluate the course and its activities? 


2.2 Participants 


Fifty-two 3™ year students (24 M, 28 F — avg age 21.8) from the Three- 
Year Degree Course in Psychology 


2.3 Context 


The course described here was on Experimental Pedagogy, and used 
blended learning by integrating face-to-face and online lessons hosted 
by the Sapienza Moodle (<http://elearning2.uniroma1.it>). The course 
lasted 10 weeks and was subdivided into three modules lasting approxi- 
mately three weeks each. 

Students were divided into six groups of about nine people each; the 
groups’ membership remained unchanged throughout the entire course. 

The following table shows the learning design of the course, describ- 
ing how the design principles were applied to the activities (Table 2). 


Table 2 — TLA principles in the course. 


Design principle Implementation in the case 


The final object to be built by each group was a pedagogical sce- 
nario in which technology-mediated collaborative activities were to 


DP1: Organizing ac- be designed. Learning topics and intermediate collaborative prod- 
tivities around shared ucts were the basis for the construction of the pedagogical scenario. 
objects In particular, the last artefact was a significant and useful ob- 


ject, connecting the group with the broader community. In fact, 
teachers from different Degree courses can all use these projects. 


Learning discussions were organized in which students had to 
bring their personal ideas as well as re-elaborations of scientific 
and pedagogical issues. Discussions and the following activities 
of product building were supported by allotting four specific 
roles: Social Tutor (task: promoting each group member’s par- 
ticipation), Synthesizer (task: writing a weekly summary of the 
group discussion), Sceptic (task: presenting alternative points of 


DP2: Supporting in- view to ‘warm’ the discussion), Head of the Collaborative Ar- 
tegration of personal tefact (task: arranging tools and materials for the collaborative 
and collective work classroom activity of building the artefact). 


Interaction between the groups was ensured by classroom pres- 
entations of the works and peer-review activities aimed at im- 
proving the group work. 

Reflection on students’ own participation and responsibility 
(agency) was solicited by compiling personal Learning Diaries, 
consisting of different stimuli to allow students to analyse their 
path more systematically and improve their own participation. 
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DP3: Emphasizing 
development and 
creativity 


During the course, the students dealt with various kinds of knowl- 
edge, ranging from the theories studied and taught by the teach- 
er to concrete examples of didactic activities illustrated through 
films, charts, stories, and analyses of scientific articles, till the 
final phase of constructing their artefacts, which all of these dif- 
ferent formats had to become part of. 

Personal and group reflection was repeatedly stressed in the group 
discussions around the teachers’ evaluations at the end of each 
module, also by compiling observation forms and reading these 
in groups, and finally, through the Learning Diaries. 


DP4: Fostering 
long-term process- 
es of knowledge 
advancement 


The learning activities lasted ten weeks and were organized in 
3 different modules, thus including many moments of transition 
in which to reflect upon the previous phase. 

The course was designed so that theoretical knowledge on the 
teaching and learning themes was repeatedly taken up and re- 
flected on, in view of its practical application within the planned 
pedagogical scenario. 

Moreover, the artefacts were reviewed and improved through ad- 
vice given: a) by the teacher in the plenary presentation, b) by the 
pairs through the peer feedback review — based on a specific tem- 
plate, c) by experts (primary, secondary and university teachers) 
during the final stage of constructing the pedagogical scenario. 


DP5: Promoting 
cross-fertilization of 
knowledge practices 


Students were able to experience the practices and methodologies 
of learning design in schools and higher education. Each group 
was supported and advised by an expert in the level of educa- 
tion chosen as the specific topic of their project. Thus, primary 
or secondary school teachers reviewed and provided feedback 
on their school-level projects, while a university physics pro- 
fessor provided feedback on a project to do with collaborative 
work between physics students, designing artefacts in that field. 


DP6: Providing flex- 
ible tools for devel- 
oping artefacts and 
practices 


During the activities, several tools were used. Students interacted 
in small groups within Moodle courses. To perform the vari- 
ous activities, tools such as Padlet (brainstorming in the class- 
room), Google Drive Design Tool (to create shared conceptual 
maps), and Shared Google Documents (to collaboratively write 
the project) were used. 


To effectively apply the TLA prescriptions, each module had a spe- 
cific focus which the corresponding activities and products to be built 
came from, as shown below (Tab. 3). 


Table 3 — Discussions, activities, and artefacts in each module. 


Theoretical Contents 


Discussions/Activities Artefacts 


First Teaching/learning “The good teacher’: Conceptual map on 
Module theories Discussion ‘The good teacher’ 
Second School history, Analysis of scientific Draft of the pedagogi- 
Module learning technologies articles cal scenario stressing the 


theoretical principles 
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Third Technologies and col- Searching for best prac- Final pedagogical 
Module laborative learning tices on technology at scenario 

school; school; collab- 

orative writing of the 

project 


2.4 Tools and procedure 


The study presented here is based on the Design-Based Approach 
(DBA) (Brown, 1992; Collins, 1992; Design-Based Research Collective, 
2003) which seeks to plan and implement innovative interventions, to 
then observe and analyse working elements as well as areas for improve- 
ment, and ultimately, re-design further interventions. The method of 
data collection and analysis combines qualitative and quantitative ap- 
proaches. Specifically, the following data were collected: 


1) First research question 

Forty-three anonymous pre-post questionnaires, namely, the Con- 
textual Knowledge Practices Questionnaire (Muukkonen et al. 2016). 
This was self-administered using Google Drive modules (<https://drive. 
google.com>) and consisted of: a) a pre-post section containing 21 items 
on perceptions relating to studies and abilities; b) a post-section consist- 
ing of 27 items examining the perception of any knowledge and skills 
acquired during the course and its activities. These items were organized 
in seven scales built around the TLA design principles. 

Answers to the questionnaires were analysed using SPSS. 


2) Second research question 

Three Focus Groups (FGs) were held at the end of the course. Stimuli 
aimed to detect students’ views on: their preferred activity (usefulness in 
terms of learning and skills); the role taken; pros and cons of group work; 
the assessment methods (ongoing, self-assessment, peer-observation); and 
the differences between the course just completed and traditional ones. 
To favour a critical and diversified discussion, the FGs consisted of stu- 
dents from each group. 

The transcripts were analysed using qualitative content analysis, aimed 
at defining categories to group the key concepts. 


2.5 Results 


1) Do students perceive an evolution in the level of skills they mas- 
tered at the beginning and end of the course? 

The results show a general perception of skills enhancement (Table 
4), with statistically significant differences, both for the Work Compe- 
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tence scale (Wc), (t = —4.48 (42) p < .01), and for the Self-efficacy scale 
(Se) (t = —2.955 (42) p < .01). At the end of the activity, the students felt 
that they had more collaborative work skills and felt greater confidence 
in their skills. 


Table 4 — Differences in perception of incoming and outgoing skills. 


N = 43 (24F.; 19 M.) Entry Exit 
Work competence 3.60 3.95 
Work engagement 3.53 3.53 

Self efficacy 3.86 4.03 
Total 3.63 3.79 


No significant differences were found for the gender variable either 
in entry or in exit for Wc and Se. Instead, the Work Engagement scale, 
presented statistically significant differences in exit (One-Way ANOVA f 
= 6.343 (42) p = .016). It seems that the course led the girls to feel more 
involved (M = 3.69) than the boys did (M = 3.23). 

Specifically, students believed that the course had allowed them to 
improve their skills in each of the areas investigated, the average score 
being above 3 in all seven scales (Fig. 2). In particular, they believed 
they had learnt to collaboratively build knowledge objects (scales 1 and 
2, Average 4 and 3.91) and make these artefacts iteratively better (scale 
4, 3.90), also thanks to the feedback received from their peers and the 
experts (scale 3, Average 4). 

Furthermore, they perceived that they had learnt new ways to use 
technologies (Average 3.88). However, they believed that they had only 
partially learned to collaborate and communicate in an interdisciplinary 
way (scale 6, Average 3.34). 


Figure 2 — Perception of skills development after the course (Likert scale 1-5) 
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As for possible gender differences, female students generally expressed 
a higher perception, but no significant differences were found in any 
items or scale. 


2) How do students evaluate the course and its activities? 

Generally, students showed appreciation for the course, especially 
when comparing it to traditional ones. Compared to the latter, the course 
was recognized as exciting and engaging, capable of generating «inter- 
est in a pedagogical subject and a desire to go deeper into the topic» and 
made attractive by the idea of «working together towards a common 
goal», even if this was considered as requiring a greater commitment and 
effort «than having to just study from a book» because, on this course, 
«you have to attend the class and engage all through the course». 

In the following table (Tab. 5), we have highlighted the pros and cons 
the students saw in the different aspects of the course which they them- 
selves pointed out as most relevant. 


Table 5 — Pros and cons of individual aspects of the course from a student perspective. 


Pro Cons 

— a real innovation, not existing — issues relating to a non-homoge- 

in other courses neous participation by some group 
Group-work — a stimulus for individual partici- members 

pation, as well as supporting real 

interdependence 

— the possibility to really get to — the tendency of some peers to 
renee know many points of view write lengthy notes on web forums, 
dasa — engaging material and content without having read others’ — lim- 

SENT (e.g. articles and project) ited time dedicated to both the sec- 
ond discussion and the project 

— the Synthesizer role promoting — the up-down role distribution 

a higher focus on the discussion not considering personal inclina- 
Role Taking —the Tutor role connecting on- tions and availability 

line and offline activities — tutor’s stimuli seen as critical and 


therefore not implemented 


— ongoing evaluation seen as use- — structure of the Learning Di- 
i ful for self-monitoring ary perceived as too binding or 
Evaluation and A m 
< — self-assessment considered as repetitive 
self-evaluation |. $ . : ; 7 
triggering good reflection — also, its lack of anonymity as im- 


pacting authenticity 


— a possibility to improve, both by — feedback given not always 


Peer review ee ea ; 
receiving and providing feedback constructive 


Online —the chance to be connected at — web forum not supporting proper 
environment any time, even via smartphones discussions because of its structure 


In detail, we can see how group work was the real added value of the 
course, as claimed in the following excerpt: «This course was the most 
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pleasant of all my three years, because it was based on exchanging ideas, 
thinking all together; the opposite of the usual boring frontal lessons». 
Probably, the group work had this impact on the students’ perception 
since it worked well (as already mentioned, the designers paid great at- 
tention to integrating individual and collaborative agencies as stated in 
DP2): «For me it was reassuring that it was not a thing like, “as a group 
we decide what to do and then a single person does the job”, but that 
everyone had to and could participate». 

Among the activities of the course, however, some were considered more 
able to promote useful skills for future profession, such as the Learning Dia- 
ries, considered «useful also for the profession we will choose. Putting into 
writing and finding out what’s going on, what I feel, somehow helped me 
to recognize it right when it was happening and to adjust my behaviour. 

Weaknesses and limits were also pointed out by the students, starting 
from the online discussions of the first module (see Tab. 4): «At a certain 
point I said to my group-mates, “listen, please, could you stop doing 
thirty-line monologues? Could we start and have a discussion? Because 
in my opinion that’s what you have to do [...] do you really think I’m 
going to go read ten posts of thirty lines that have nothing to do with 
each other? [...]”. This complaint, however, ended with a possible solu- 
tion: “maybe you should present it a bit more like a debate”». 

In other cases, suggestions referred to more practical aspects, such as 
the timeframes: «In my opinion, the problem was that in the second mod- 
ule we discussed the added value technologies for too long (...) and then, 
suddenly, on the day, we were told to design a project ... so [...] I would 
redefine the timeframe, giving a whole third module to the drafting of 
the project [...] or I would have put in a fourth module». 


3. Final remarks 


In this contribution we have described a university course based on 
the Trialogical Learning Approach and the study we performed to detect 
its impact on students’ appreciation of the learning activities and percep- 
tions relating to their skills development. 

Collaborative activities, continuous development of knowledge ob- 
jects, active use of technology, and the possibility to learn different dis- 
ciplines and practices, were recognized and appreciated by the students 
as key factors of the course, after which they perceived that they had re- 
inforced some skills crucial for their future career. 

According to the DBA method that inspired our work, and to fur- 
ther enhance the overall student experience, in future courses we will 
be paying attention to the critical areas reported by the students: partici- 
pation in work groups, certain tools and materials, and the timeframes. 
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Finally, we will focus on improving interdisciplinary collaboration and 
communication, perceived as the most underdeveloped skill. 
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